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1. INTRODUCTION 

Earlier, a lot of researches were undergone for robots in recreational uses. Now, the researchers 
concentrate and dedicated consider able attempt on emergent robots which is capable to counterpart human 
behavior on high level tasks. To achieve these robots, it involves integration of various elements (namely 
computer vision, physical motion, and intelligence). By these integrations in robot, it makes the behavior to be 
more like human. One such type of robot is the drawing robot. In recent days, quite a lot of exhibitions of 
drawing robots have taken place. A lot of researchers have been working on the DrawBot to perfect it and each 
of them has come up with their own unique ideologies. A notable few are listed in the paragraphs that follow 
[1]-[5]. 

The robotic installation named, Robot Paul can reproduce facial features of people by capturing an 
image and processing it. Paul cannot reproduce these as good as an artist. However, Paul did deploy several 
techniques to imitate drawing skill. BARC, Mumbai made a demo to perform portrait drawing on a complex 
surface [6]-[9]. They did so by employing sensors to detect forces acting on the drawing tool and identifying 
the tool’s orientation with respect to the drawing surface. 

Kumar and Kumar [10] proposed a morphological method of segmenting the image. This method had 
various stages for image segmentation. They were preprocessing the input image, then conversion of color 
space followed by adjusting the threshold values, after which the image has to go through feature extraction, 
segmentation of the image and at last valuation. A new approach to text detection was proposed by Li and Lu 
[11], which was based on the width of stroke. Initially, to extract the character candidates, distinctive contrast 
improved maximally stable extremal regions (MSER) algorithm is designed. Next to eliminate the non-text 
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regions, effortless geometric limits are applied. Secondly, set of rules for the geometry of text were introduced 
to remove non-text regions. Also including the generated stroke width ensured to eliminate all remaining 
irrelevant areas. Then the remaining areas are clustered to form text regions [12]-[16]. Their algorithms turned 
out more favorable compared to other sophisticated solutions. Neumann and Matas [17] elaborated about a real 
time text detection and recognition was ventured in this paper. A set of extremal regions were posed to make 
selection in sequence which enabled real time detection of text. This method proved efficient and reliable 
against blur, varying light intensities, and made it possible to handle very low contrast text [18]-[20]. Alvaro 
etal. [21] proposed to localize text more accurately and reliably. Proper character candidates were to be found 
in the first stage. Later, an analysis based on connected components to discard non text regions and accept text 
candidates. At the final step, with gradient features a text line classifier to support vector machines. The paper 
described by Huizhong et al. [22] focused on detecting text from natural image where it introduced edge 
enhanced MSER approach to detect text regions for more suitable candidates. Geometry and Stroke width data 
enabled to eliminate non text regions. Text regions were grouped to form as words [23]-[25]. 

The first step in this work is aimed at designing a robot which can perceive a design shown to it and 
accurately reproduce it on any given area as directed. It can be used for decoding of unreadable scriptures and 
reproducing them, can also come in handy in situations where markings in parking areas or fields have to be 
made in short periods of time, during interior design painting of houses, and in Sail making and intricate 
detailing of vehicles. Even printing huge billboards using printers are cumbersome as the printing process has 
to be fragmented and if automated one can save time and improve efficiency. This DrawBot can be used to 
replicate text in an image on a drawing board. This can come in handy in situations where the human eye finds 
it hard to read and recognize letters in an image. 


2. DESIGN AND FABRICATION OF PROPOSED ROBOT 

The software for modeling of the drawing robot used in this work was done using SolidWorks 2016b 
software with representation of 3-D geometries and analyzing various proximities associated to modeling and 
action. Two cylindrical links with lengths 17.5 cm and 21.5 cm were modelled. A base was designed to hold 
the robotic arm. There were 3 Servo motors out of which the first one was attached to the base, the second one 
was attached at the inter-section of the first and the second link mounted on a servo bracket and the final motor 
was attached to the end effector to help positioning the pen on the drawing board. A metal horn was attached 
to the shaft of the motor seated on the base. Over the metal horn a hub-link connector was attached to be able 
to attach the robotic arm to the base servo motor. The two links were mounted on the base as shown in the 
Figure 1. The material chosen was Aluminum 6061. 


Figure 1. SolidWorks design of the DrawBot 


2.1. Stress analysis 

In order to determine the stress and strain in materials, the Stress-strain analysis (or stress analysis) 
uses various methods. To check the stress bearing capacity of the design, stress analysis was performed using 
SolidWorks software. With the calculation of maximum possible load on the body, the maximum deformation 
on each part of the design was tested. The yield strength was noted and cross verified with the stress in each 
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part to make sure that the stress is much below the yield strength. Stress analysis in SolidWorks contains the 


following: 


— Creating the part/assembly that is to be used. 


— New study is started from the simulation Add-In. Material is chosen from the SolidWorks database. 


— Fixtures are chosen for instance sliders, elastic supports, or rollers. 


— External loads are chosen (for example: pressures, torques and forces), other options that can be added 


are distributed mass, gravity, or centrifugal forces. 
—  Runthe simulation model created. 


The displacement and stress analysis results obtained for HubLink connector and Link are as shown 
in Figures 2 and 3. Similarly, the displacement and stress analysis results obtained for multipurpose Bracket 


and U bracket are as shown in Figures 4 and 5 (see in appendix). 
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Figure 2. Displacement and stress analysis of HubLink connector 
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Figure 3. Displacement and stress analysis of link 


3. METHOD 
3.1. Input image 

Considering that the first step of the work was to identify letters from an image, an image with letters 
was first clicked. An input image of any format (JPG, PNG) is then uploaded to the system. Then the image is 
added to the path of the image processing code. The flow of the proposed method is explained schematically 
in the Figure 6. 


3.2. Extraction of letters from image 

The following steps are performed in the image processing code where the letters in an image are 
identified. As mentioned in the flow chart in Figure 7, initially by using MSER the candidate text regions are 
detected. The MSER is used as mentioned before is best to find the text regions. Then the non-text regions are 
removed which is based on geometric features. Even though the MSER is capable of selecting the most text 
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available, it also identifies other regions which are not a text in the image available. The program utilizes a 
normal rule-based method. This is done basically to extract the non-text regions in the image. Next the final 
detected result is obtained by merging all the text regions. At last, the OCR is utilized to detect the recognized text. 


Input Image —— MATLAB | 


Image Processing using Matlab 


Inverse Kinematics 
Using Simulink 


Generating control 
Algorithm for Arduino 


DA uos 
z 


Servo motor Arduino Uno 
control 


Figure 6. Proposed methodology 


Identifythe text regions 
of candidate using MSER 


Based on the basic geometric properties 
the non-text regions are removed 


To obtain the result of final detection, 
now merge the text regions 


Finally use OCR to recognize the detected 
text 


Figure 7. Flow of the image processing work 


4. RESULTS AND DISCUSSION 
4.1. Simulation results 

The Figure 8 depicts the MATLAB Simulink block diagram to do inverse kinematics and find out the 
angles thetal and theta2 in which the robotic arms should be moved. The left side of the image is the part where 
the formula for finding the angles using inverse kinematics is solved. The images right side contains the code 
to display, angles thetal and theta2 and also shows a simulation output graph in Figure 9, that gives an idea of 
what the end drawing result will be when the two arm links move in the angles they get from inverse kinematics 
as depicted in Figure 10. 

The X, Y points are then substituted manually and for each point thetal and theta2 are found out and 
noted. These are tabulated as presented for each and every letter. For instance, to make the DrawBot to draw 
the letter U, the X, Y point values and its corresponding theta 1 and 2 values are shown in Table 1. Similarly 
for letters V, P, T and X the corresponding values are tabulated as shown in Tables 2, 3, 4 and 5. 
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Figure 8. Simulink block diagram 
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Figure 9. Simulation plot for letter ’v’ 


4.2. Control algorithm 

Initially the image processing code in MATLAB sends the letters that it has recognized to the Arduino 
via serial communication. Arduino program accepts each and every word and stores it as string. Then each 
letter from the word is singled out. Once the angles are listed for each point in which the arm has to move to 
draw an alphabet, they are fed to the Servo motor through Arduino coding. For each alphabet and for each 
stroke the angles are fed in the form of an array. Then as each stroke progresses each section of the array is 
executed. The hardware setup for the proposed DrawBot is shown in Figure 11. 
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Figure 10. Simulation Arm diagram 


Table 1. Table for Letter 'U" 


LETTER 'U' 
STROKEI 
SNO (X,Y) Thetal Theta2 
1 (-20, 25) 90 68 
2 (-20, 22.5) 87 78 
3 (-20, 20) 86 86 
4 (-20, 17.5) 85 94 
5 (-20, 15) 85 100 
STROKE2 
SNO (X,Y) Thetal Theta2 
1 (-15, 25) 74 82 
2 (-15,22.5) 71 92 
3 (-15, 20) 69 100 
4 (-15, 17.5) 68 108 
5 (-15, 15) 68 114 


Table 2. Table for Letter ' V? 


LETTER 'V' 
STROKEI 
SNO (X,Y) Thetal Theta2 
1 (-20, 20) 86 86 
2 (-20, 22.5) 85 94 
3 (-20, 25) 85 100 
STROKE2 
SNO (X,Y) Thetal Theta2 
1 (-20, 10) 89 110 
2 (-18, 14) 79 108 
3 (-17.5,15) 77 108 
4 (-17,16) 75 106 
5 (-16, 18) 71 104 
6 (-15, 20) 69 100 


Table 3. Table for Letter ’P’ 


LETTER 'P* 
STROKEI 
S.NO (X, Y) Thetal ^ Theta2 
1 (-20, 22.5) 90 68 
2 (-20, 22.5) 87 78 
3 (-20, 20) 86 86 
4 (-20,17.5) 85 94 
5 (-20, 15) 85 100 
STROKE2 
S.NO (X, Y) Thetal Theta2 
1 (-22.5,25) 99 59 
2 (-15, 25) 74 82 
STROKE3 
S.NO (X, Y) Thetal Theta2 
1 (-15, 25) 74 82 
2 (-15, 22.5) 71 92 
3 (-15, 20) 69 100 
STROKE4 
S.NO (X, Y) Thetal Theta2 
1 (-15, 20) 69 100 
2 (-20, 20) 86 86 
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Table 4. Table for Letter ’T’ 


LETTER 'T* 

STROKEI 

S.NO (X, Y) Thetal Theta2 
1 (-10, 25) 59 92 

2 (-12.5, 25) 66 88 

3 (-15, 25) 74 82 

4 (-17.5, 25) 82 76 

5 (-20, 25) 90 68 

6 (-22.5, 25) 99 59 

7 (-25, 25) 109 47 
STROKE2 

S.NO (X, Y) Thetal Theta2 
1 (-15, 27.5) 78 72 
2 (-15, 25) 74 82 

3 (-15, 22.5) 71 92 
4 (-15, 20) 69 100 
5 (-15, 17.5) 68 108 
6 (-15, 15) 68 114 
7 (-15, 12.5) 69 120 
8 (-15, 10) 71 126 


Table 5. Table for Letter °X’ 


LETTER X^ 
STROKEI 
S.NO (X, Y) THETAI THETA2 
1 (-20, 25) 90 68 
2 (-19, 23.5) 85 77 
3 (-18, 22) 80 86 
4 (-17, 20.5) 16 93 
5 (-16, 19) 72 101 
6 (-15, 17.5) 68 108 
7 (-14, 16) 64 114 
8 (-13, 14.5) 60 121 
9 (-12, 13) 56 127 
10 (11, 11.5) 52 133 
11 (-10, 10) 48 139 
STROKE2 
S.NO (X, Y) THETA1 THETA2 
1 (-10, 25) 59 92 
2 (-11, 23.5) 60 96 
3 (-12, 22) 61 100 
4 (-13, 20.5) 63 103 
5 (-14, 19) 65 105 
6 (-15, 17.5) 68 108 
7 (-16, 16) 71 109 
8 (-17, 14.5) 75 110 
9 (-18, 13) 79 111 
10 (-19, 11.5) 84 111 
11 (-20, 10) 89 110 


Figure 11. Hardware setup for the proposed DrawBot 
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5. CONCLUSION 

The work was started with the sole objective of designing and fabricating a robotic arm which can 
perceive a design shown to it and reproduce it as a 2-D drawing on an even surface as directed. However, in 
the process of doing the work, it was discovered that this work can be used for a superior application such as 
reading and reproducing texts available in old historic documents and scriptures that have deteriorated in 
condition over time and are hard to read. The knowledge in image processing in MATLAB along with working 
extensively with it to do inverse kinematics was incorporated to obtain servo angles. In future the scope of our 
draw-robot can be increased by improving its ability to not just replicate letters but also shapes and extremely 
complex designs. We would also like to enhance it such that it can read and reproduce contents of other major 
languages in the world as well. As of now our work uses servo motors to control the movement of the arm 
links however in the future, we would like to replace it with stepper motors as they would be easier to work 
with for precision applications such as ours. 
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Figure 4. Displacement and stress analysis of multipurpose bracket 
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Figure 5. Displacement and stress analysis of U bracket 
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